| Source | # of sentences | Average logarithmic rank |
|---|---|---|
| http://isizulu.news24.com/Izindaba-Zami/Izingane-zibadinga-bobabili-abazali-20110916 | 12 | 6.41 |
| http://www.iol.co.za/isolezwe/singathanda-ukudla-eseligi-cavin-johson-1.1503258 | 13 | 6.50 |
| http://www.iol.co.za/isolezwe/kusageleza-inhlanhla-kukaizer-chiefs-1.1427171 | 14 | 6.64 |
| http://www.iol.co.za/isolezwe/kwehluka-imibono-ngodaba-lwabaqwayizi-1.1274206 | 15 | 6.65 |
| http://www.iol.co.za/isolezwe/ugwayi-katiki-esikoleni-sobudokotela-1.1261270 | 14 | 6.68 |
| http://www.iol.co.za/isolezwe/bacabanga-ukuthutha-abashonelwe-1.1488080 | 11 | 6.70 |
| http://www.iol.co.za/isolezwe/ufuna-kuphenywe-ngokuhoxiswa-kwecala-1.1333894 | 11 | 6.73 |
| http://www.iol.co.za/isolezwe/umatlaba-ugaqele-isikimu-kubafana-1.1441510 | 12 | 6.75 |
| http://www.iol.co.za/isolezwe/umfundi-ukhala-ngokuhlukunyezwa-1.1433645 | 11 | 6.76 |
| http://www.iol.co.za/isolezwe/isikhalo-nge-clinic-evula-kabili-ngenyanga-1.1332261 | 11 | 6.76 |
| http://www.iol.co.za/isolezwe/ufuna-ukungena-emlandweni-u-igesund-1.1447647 | 12 | 6.77 |
| http://www.iol.co.za/isolezwe/uhlukile-owe-wits-kulokhu-baxter-1.1479128 | 14 | 6.77 |
| http://www.iol.co.za/isolezwe/akafuni-nokuyizwa-eyebafana-bafana-unozinti-webucs-1.1337939 | 11 | 6.78 |
| http://www.iol.co.za/isolezwe/ibafana-kuzomele-iqine-njenge-bucs-1.1528809 | 15 | 6.81 |
| http://www.iol.co.za/isolezwe/umasalesa-noma-ujali-inkinga-kade-sa-1.1568044 | 11 | 6.81 |
| http://www.iol.co.za/isolezwe/utholwe-esengamathambo-obedukile-1.1488083 | 11 | 6.81 |
| http://www.iol.co.za/isolezwe/nabesifazane-bayahlukumezana-1.1506130 | 11 | 6.81 |
| http://www.iol.co.za/isolezwe/sinabo-abazovala-esikashabba-1.1587135 | 13 | 6.82 |
| http://www.iol.co.za/isolezwe/singabuya-namaphuzu-ayisithupha-1.1527451 | 12 | 6.83 |
| http://www.iol.co.za/isolezwe/usizi-kowashadiswa-engazi-1.1190335 | 11 | 6.85 |
| http://www.iol.co.za/isolezwe/usotakwini-ngombiko-owezemfundo-1.1406870 | 11 | 6.89 |
| http://www.iol.co.za/isolezwe/ombombayi-bakamatric-ekzn-1.1451350 | 11 | 6.89 |
| http://www.iol.co.za/isolezwe/inkombane-ngebhilidi-elihlala-abakahulumeni-bhusende-1.1516807 | 13 | 6.90 |
| http://www.iol.co.za/isolezwe/ukhala-ngamashwa-umgadli-wedowns-1.1379498 | 14 | 6.94 |
| http://www.iol.co.za/isolezwe/kushone-abadlali-abangu-6-engozini-1.1421640 | 15 | 6.94 |
| http://www.iol.co.za/isolezwe/kuzoqiniswa-umthetho-kwabamakayo-1.1421652 | 13 | 6.94 |
| http://www.iol.co.za/isolezwe/i-anc-iphikisa-ibheyili-kosolwa-kwelokubulala-1.1424127 | 11 | 6.96 |
| http://www.iol.co.za/isolezwe/umosimane-ubheke-upienaar-ngamagoli-1.1306904 | 12 | 6.98 |
| http://www.iol.co.za/isolezwe/bacasula-ukaizer-abahhahhamezayo-1.1491878 | 12 | 6.99 |
| http://www.iol.co.za/isolezwe/ichiefs-ithembele-kumajor-kowosuthu-1.1442340 | 11 | 6.99 |
| Source | # of sentences | Average logarithmic rank |
|---|---|---|
| http://isizulu.news24.com/Izindaba-Zami/Iyakhathaza-eyobugebengu-bamakhompyutha-ISS-20130919 | 11 | 8.94 |
| http://www.iol.co.za/isolezwe/amazwibela-ama-soapie-1.1491230 | 16 | 8.21 |
| http://www.iol.co.za/isolezwe/amazwibela-ama-soapie-1.1496856 | 18 | 8.16 |
| http://www.iol.co.za/isolezwe/amazwibela-ama-soapie-1.1510920 | 18 | 8.09 |
| http://www.iol.co.za/isolezwe/amazwibela-ama-soapie-1.1446467 | 12 | 8.00 |
| http://www.iol.co.za/isolezwe/isakhiwo-se-chev-spark-siqondiswe-kubantu-abasha-1.1230741 | 11 | 8.00 |
| http://www.iol.co.za/isolezwe/uthola-konke-ongase-ukucabange-ku-ds5-enesitayela-1.1299126 | 14 | 7.99 |
| http://www.iol.co.za/isolezwe/yini-ebenza-bahluleke-ukuvala-uziphu-1.1556056 | 15 | 7.95 |
| http://www.iol.co.za/isolezwe/amazwibela-ama-soapie-1.1539953 | 17 | 7.94 |
| http://www.iol.co.za/isolezwe/ukudayiswa-kwe-yaris-kube-ngokudumazayo-kwa-toyota-1.1274138 | 15 | 7.92 |
| http://isizulu.news24.com/Izindaba-Zami/Bahlukene-phakathi-ngoluthinta-uZuma-Umbono-20120620 | 15 | 7.91 |
| http://www.iol.co.za/isolezwe/ungazuza-lukhulu-kwi-alex-the-crew-1.1282782 | 12 | 7.89 |
| http://www.iol.co.za/isolezwe/ichiefs-ingase-yehle-esicongweni-se-log-1.1469433 | 12 | 7.89 |
| http://isizulu.news24.com/SiteElements/Top-Component/Sakhathala-ukunukelwa-nokubuka-ubuntu-bamadoda-20130731 | 11 | 7.86 |
| http://www.iol.co.za/isolezwe/sebethule-entsha-enesinqa-i-honda-brio-1.1552562 | 11 | 7.85 |
| http://www.iol.co.za/isolezwe/kusemnyama-kwacijwa-yizinkakha-1.1581476 | 12 | 7.84 |
| http://www.iol.co.za/isolezwe/kuningi-esingakufunda-ngoshenge-1.1230555 | 14 | 7.83 |
| http://isizulu.news24.com/Izindaba-Zami/Zisengabuyela-emasisweni-20110719 | 12 | 7.82 |
| http://www.iol.co.za/isolezwe/iza-nobuchwepheshe-besimanje-i-coupe-1.1308604 | 14 | 7.82 |
| http://www.iol.co.za/isolezwe/kugcwele-izinyoka-kumazulu-vilakazi-1.1536511 | 12 | 7.80 |
| http://www.iol.co.za/isolezwe/bafuna-ithengwe-kakhulu-irenault-clio4-1.1502447 | 14 | 7.80 |
| http://www.iol.co.za/isolezwe/ucebekhulu-ulaxaza-isibhakela-1.1537063 | 11 | 7.79 |
| http://isizulu.news24.com/Izindaba-Zami/Impi-esingeke-siyinqobe-Umbono-20130919 | 13 | 7.79 |
| http://www.iol.co.za/isolezwe/kutholwe-izidakamizwa-nezikhali-esikoleni-1.1236805 | 11 | 7.79 |
| http://www.iol.co.za/isolezwe/ngisho-nabomthetho-bathathekile-nge-toyota-86-1.1509325 | 11 | 7.79 |
| http://www.iol.co.za/isolezwe/amagama-ezinhlelo-ayasiza-ekuheheni-abalaleli-bomsakazo-1.1519218 | 11 | 7.78 |
| http://www.iol.co.za/isolezwe/ingonyama-iqhakambise-iqhaza-le-anc-1.1238882 | 11 | 7.78 |
| http://www.iol.co.za/isolezwe/yini-edala-abesifazane-babulale-amadoda-1.1506058 | 16 | 7.77 |
| http://www.iol.co.za/isolezwe/ningafihli-uma-isiguli-sinikwe-amakhambi-1.1264639 | 21 | 7.76 |
| http://www.iol.co.za/isolezwe/amazwibela-ama-soapie-1.1467812 | 19 | 7.74 |
In this subsection we replace average word length by average logarithmic word rank. The logarithm of the word rank is taken because we want to punish words of high ranks only moderately.
First table:
select source, count(distinct i_s.s_id) as cnt_s, round(avg(log(w.w_id-100)),2) as av from sources so, inv_so i_s, inv_w i, words w where so.so_id=i_s.so_id and i_s.s_id=i.s_id and i.w_id=w.w_id and w.w_id>100 group by source having cnt_s>10 order by av LIMIT 30;
6.4.2.1 Average word length for different sources
6.4.2.3 Sources consisting of many / few words with frequency 1
6.4.2.4 Sources with low / high average word length of rare words